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1.  INTRODUCTION 


Our  purpose  here  Is  to  review  the  method  of  K.  RITTER  (1964)*  ( 19^5 ) > 
(1966)  for  obtaining  a  global  solution  to  a  linearly- constrained  quadratic 
minimization  problem.  In  writing  this  primarily  tutorial  paper,  we  have 
made  some  modifications  and  introduced  an  example  that  we  hope  will 
contribute  to  a  better  understanding  of  an  important  algorithm.  As  a 
matter  of  fact,  Ritter's  method  is  the  only  rigorous  procedure  we  know 
of  for  solving  the  general  quadratic  programming  problem.  Other  algorithms 
exist,  but  they  fail  to  fit  this  description  because  of  their  logical  gaps 
or  their  less  ambitious  nature.  Examples  of  the  latter  type  are  the 
frequently  advanced  proposals  for  obtaining  a  local  minimum  of  a  concave 
quadratic  function  over  a  polyhedral  convex  set. 

The  problem  with  which  we  are  concerned  can  be  stated  without  loss  of 
generality  as 

(l.l)  minimize  cp(x)  -  cTx  +  j?xTDx 

subject  to  Ax  ^  b 
x  ^  0 

where  the  matrix  A  is  of  order  m  X  n  and  D  =  DT  .  If  D  is  positive  semi- 
definite,  or  more  precisely,  if  cp  is  a  convex  function  on  the  convex 
polyhedral  constraint  set 

X  =  fx  :  Ax  ^  b,  x  &  0}  , 


then  (l.l)  is  called  a  convex  quadratic  program.  There  is  an  abundant 
literature  on  convex  quadratic  programming,  and  the  interested  reader 


may  consult  the  volumes  by  KUNZI  and  KRELLE  (1962),  BOOT  (1964), 

ABADIE  (1967),  and  DANTZIG  and  VEINOTT  (1968)  for  a  selection  of 
algorithms  and  an  ample  supply  of  further  references.  Ritter's  method, 
described  in  this  paper,  is  designed  to  handle  problems  of  the  form  (l.l) 
in  which  the  convexity  of  tp  on  X  is  not  assumed. 

The  quadratic  programming  problem  is  a  sort  of  bridge  between  linear 
and  nonlinear  programming.  It  might  also  be  said  that  the  nonconvex 
quadratic  programming  problem  is  a  bridge  between  integer  and  nonlinear 
programming.  This  alone  should  be  sufficient  to  sustain  one's  interest 
in  techniques  for  efficiently  solving  difficult  problems  of  this  kind. 

Ritter's  method  is  composed  of  three  distinct  phases.  Its  Phase  I 
is  essentially  the  same  as  that  of  the  Simplex  Method  for  linear  program¬ 
ming  (see  DANTZIG  (1963)).  This  procedure  is  used  to  determine  whether 
there  exists  a  vector  satisfying  the  constraints;  indeed,  it  produces 
an  extreme  point  of  the  constraint  set  X  if  and  only  if  that  set  is  non¬ 
empty.  Once  this  has  been  settled  in  the  affirmative,  another  aspect 
of  Phuse  I  deals  with  expressing  the  objective  function  in  terms  of  the 
independent  (i.e.,  nonbasic)  variables.  The  extreme  point  at  hand  then 
is  used  as  the  starting  point  for  Phase  II  which  determines  either  a  local 
minimum  or  gives  an  indication  that  the  objective  function  is  not  bounui-d 
below  on  the  constraint  set.  Phase  III  is  a  method  for  constructing  a 
cutting  plane  that  excludes  the  previously  located  local  minimum  without 
excluding  the  global  minimum  if  it  has  not  yet  been  found.  After  the 
cutting  plane  is  placed,  (i.e.,  adjoined  as  a  constraint)  the  Phase  I 
procedure  is  reapplied  to  the  augmented  problem.  Termination  can  occur 
in  Phase  I  if  no  feasible  points  remain  after  placing  the  cutting  plane, 
or  it  can  also  occur  in  Phase  III  after  a  weak  sufficiency  condition  for 


a  global  minimum  is  satisfied,  or  with  an  indication  that  cp  is  not 
bounded  below  on  the  constraint  set.  Ihe  number  of  calculations 
preformed  in  each  phase  is  finite.  RITTER  (1964),  (1966)  proved  that 
if  X  is  a  bounded  set,  then  the  method  cycles  through  the  three  phases 
only  a  finite  number  of  times.  The  finiteness  of  this  method  for 
unbounded  constraint  sets  is  an  unsettled  question. 

It  is  our  Intention  in  this  paper  to  motivate  and  explain  Phases 
II  and  III  as  developed  by  RITTER.  Both  of  these  phases  depend  on  being 
able  to  distinguish  a  local  minimum.  Ir  Section  we  set  forth  the 
necessary  and  sufficient  conditions  characterizing  a  point  as  a  local 
minimum  of  a  quadratic  programming  problem.  Section  3  iB  concerned  with 
the  construction  of  the  cutting  plane  at  a  given  local  minimum  (i.e., 
Phase  III).  We  describe  Ritter's  algorithm  for  finding  a  local  minimum 
in  Section  4  where  we  include  a  small  example  illustrating  how  the 


method  works . 


2.  NECESSARY  AND  SUFFj  CEENT  CONDITIONS  FOR  A  LOCAL  MINIMUM 
The  quadratic  program  again  is 

(2.1)  minimize  cp(x)  =  cTx  +  g-xTDx 

subject  to  Ax  i  b 

x  i  0 

where  A  is  of  order  m  X  n  and  D  is  symmetric.  The  problem  determines 
a  polyhedral  convex  constraint  set  X  given  by 

(2..  )  X  =  fx  6  If  :  Ax  i  b,  x  i  0) 

By  a  local  minimum  of  <p  on  X  we  shall  mean  a  vector  x  €  X  for  which  there 
exists  a  positive  scalar  c  and  a  corresponding  «-neighborhood,  N(x,c)  * 
fx  €  If  :  ||x  -  x||  <  c},  suchthat  <p(x)  £  sp(x)  for  all  x  €  X  H  N(x,c).  If 
the  latter  injquality  holds  for  all  x  €  X,  then  x  is  called  a  global 
minimum  of  tp  on  X.  This  is  all  perfectly  standard,  and  we  make  this 

explicit  statement  only  to  emphasize  our  use  of  the  term  local  (global) 

a 

minimum  with  reference  to  the  point  x  rather  than  the  functional  value 
cp(x).  Ry  solving  (2.1)  we  mean  obtaining  a  global  minimum  of  9  on  X  or 
showing  that  none  exists. 

The  Kuhn-Tucker  theorem  on  necessary  conditions  of  optimality  is 
ismediately  applicable  to  the  quadratic  programming  problem  because  the 
constraints  are  linear  and  consequently  the  Kuhn-Tucker  constraint  qualifi¬ 
cation  is  satisfied  at  all  relative  boundary  points  x  €  X.  As  originally 
stated,  the  Kuhn-Tucker  theorem  pertains  to  global  minima.  However,  it  is 
well  known  (and  clear  from  their  proof)  that  the  so-called  "Kuhn-Tucker 


conditions"  must  obtain  at  a  local  minimum,  Just  as  at  a  global  ainim-jm. 
It  is  also  well  known  that  these  conditions  can  hold  at  points  which 
are  not  local  minima.  For  this  reason,  one  says  that  in  general  they 
are  necessary  but  not  sufficient.  We  state  them  now  in  a  special  way 
for  the  problem  at  hand. 

(2.3)  THEOREM  (KUHN  and  TUCKER  (1951)):  If  x  Is  a  local  minimum  of  cp 
on  X,  there  exists  a  vector  y  such  that 


(2.3a) 

c  +  Dx  - 

ATy  ^  0 

(2. 3b) 

-b  +  Ax 

*  0 

(2.3c) 

X  2:  0 

( -°  •  3d ) 

y  *  0 

(?-3e) 

xT[  c  +  Dx  - 

ATy]  =  0 

(2. if) 

yT [-b  +  Ax 

]  =  0 

We  refer  to  (2. ja)  through  (?.3f)  as  the  Kuhn- Tucker  conditions  of  (2 . 1 ) 
and  any  pair  (x,y)  €  R"  X  R*  satisfying  them  will  be  called  a  Kuhn- Tucker 
point .  A  stationary  point,  x,  of  cp  on  X  is  one  for  which  there  exists 
a  y  such  that  (x,y)  is  a  Kuhn-Tucker  point.  If  the  (slack)  vectors  u  and 
v  are  defined  via  the  equations 


(3.4a) 

u 

c 

+  Dx  -  ATy 

(2.4b) 

V 

-b 

+  Ax 

the  Kuhn-Tucker 

conditions  can 

be 

rendered  as 

(3.5)  u  >  0, 

x  -*  0,  y  >  0, 

v  > 

0,  xTu  =  0,  yTv 

-5- 


r.rt^blf  s  Xj  and  Uj  are  paired  and  are  a  aid  to  be  complementary 
(or  oi  each  other).  “The  same  temluo3.ogy  applies  to  the 

jr*  v.4 . 

ht.  it  turns  out,  .=  exposition  of  this  theory  is  simplified  by 
conk  _ng  the  nonnegativity  restrictions  (x  >  0)  with  the  other  linear 
inequalities  in  one  grand  system.  Thus  v.e  can  consider  a  more  general 
system  of  constraints 

r  *  h4  i  -  l .  ,p 


and  speciali’e  It  t/  choosing  p  m  +  n  and 


Oi 


* 


hi 


i 

i 


1 ,  i  •  • ,  m 


m  +  1, . . . ,m  +  n 


1 ,  ■  ■  ■ ,  m 

m  +  1, . . .,m  +  n 


where,  for  example,  Gl#  denotes  the  i^h  row  of  a  matrix  G. 

Relative  to  the  constraints  of  the  problem  and  any  point  x  €  R“  we 
may  define 


G(x)  =  (i  :  G,#x  =  ht,  i  =  1, ...,m  +  n} 

The  constraints  corresponding  to  indices  in  G(x)  are  said  to  be  binding 
(or  active)  at  x.  The  set 

Xj  =  {x  €  R1  :  Gl#x  =  ht }  i  =  1,  ...,m  +  n 

is  a  linear  manifold  as  is 


X-CxeR"  :  x  €  Xt ,  i  €  G(x)) 


-6- 


which  is  meant  to  equal  R°  if  G(x)  = 

It  is  clearly  important  to  be  able  to  distinguish  local  minim  from 
other  types  of  stationary  points.  This  classification  problem  has  been 
rather  thoroughly  treated  by  RITTER.  (See  RITTER  (1964),  (1965)  as 
well  03  the  more  recent  and  general  work  of  McCORMICK  (1967),  or  FIASCO 
and  MCCORMICK  (1968).)  For  this  discussion,  we  adopt  Ritter's  formu¬ 
lation  of  the  problem  and  consider  the  program 

(2.6)  minimize  cTx  +  |xTDx 

subject  to  Gx  £  h 

which,  as  we  have  a' ready  noted,  includes  (2.1).  The  Kuhn- Tucker  con¬ 
ditions  of  (2.6)  are 

(2.7a)  c  +  Dx  -  GTy  =  0 

(2.7b)  -h  +  Gx  2:  0 

( ?  •  7  c )  y  *  0 

(2.7a)  yT [-h  +  Gx]  =0 

For  a  Kuhn-Tucker  point  (x,y),  i.e.,  a  solution  of  (2.7),  we  line 

G(*,y)  =  fi  G  G(x)  :  yt  >  0}  . 

If  i  €  G(x,y),  the  i^  constraint  of  (2.6)  is  said  to  be  strongly  binding . 

X  =  (x  €  R"  :xext,i€  G(x,y)}  . 

There  is  also  a  corresponding  subsystem  of  (2.7),  namely 


(2.8a) 

c  +  Dx  -  GTy  =  0 

(2.8b) 

-A  +  Gx  =  0 

(2.8c) 

0 

A 

We 
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in  which  G  is  the  appropriate  submatrix  of  G.  In  the  light  of  its  usage, 
we  will  assume  the  nonsingularity  of  the  matrix 


A 

This  implies  that  the  rows  of  G  are  linearly  independent. 

Given  a  Kuhn-Tucker  point  for  (2.6),  there  is  a  range  over  which 
the  vector  h  may  be  varied  without  causing  either  the  strongly  binding 
constraints  to  become  nonbinding  or  the  nonbinding  constraints  to  become 
strongly  binding.  Since  the  matrix  specified  by  (2.9)  is  nonsingular, 
equations  (2.8a)  and  (2.8b)  can  be  used  to  define  a  Kuhn-Tucker  point 

A  A 

as  a  function  of  h  when  h  is  chosen  from  the  set  just  described.  Over 

A 

this  range  of  h,  the  value  of  the  objective  function  cp  is  an  implicit 
function  of  £1 .  The  following  lemma  relates  the  multipliers  y 
to  the  rate  of  change  of  cp  as  A  is  perturbed. 

(2.10)  LEMMA  (RITTER  (1965)):  For  the  set  of  all  fi  such  that  (2.8) 

A 

has  a  solution,  cp  can  be  regarded  as  a  function  of  h  and  in  this  sense, 

yT  =  vftcp 


Proof.  By  the  chain  rule  for  differentiation 


we  obtain 


-8- 


These  two  equations  imply 


We  new  slat.-  Hitter's  rhur.aoterl  /.ation  theorem  for  stationary 
vints . 

(  'l'I DsOfUaf (KPITKK  If  (x,y)  is  a  solution  of  (p.8)  then: 

(i)  x  Is  a  heal  minlnruni  of  cp  c>n  X  iffcp  is  convex  on  X; 

(li)  x  is  a  1  on  1  maximum  of  y  on  X  iffX  =  R“  and  cp  is  concave; 

(ill)  x  Is  a  ; ; a  1  i  l e  point  of  cp  on  X  ilfcp  is  nonconvex  on  X  provided 

a  * 

X  /  i\  .  1 1‘  X  ,  then  x  is  u  saddle  point  iff  cp  is  neither 

convex  nor  concave. 

Proof,  (i)  Suppose  cp  is  convex  on  X  and  suppose  x  €  X.  Then 
h  :  Ox  %  A.  By  the  assumption  (P.9),  there  will  be  a  unique  stationary 


r 


point  x'  of  cp  subject  to  Gx  =  h.  Then  cpfx')  £  cp(x).  Now  if  we  choose 

x  sufficiently  close  to  x,  we  may  preserve  the  positivity  of  the 

/ 

multipliers.  The  result  cp(x)  *  cp(x  )  ^  cp(x)  now  follows  from  Lemma  (2.10). 

Conversely,  if  x  is  a  local  minimum  of  (p  on  i  then  cp(x)  i  cp(x)  for 
sill  x  €  i.  D  N(x,c).  We  have 

cp(x)  =  cp(x)  +  (cT  +  xtD)(x  -  x)  +  H'x  -  x)tD(x  -  x)  - 

cp(x)  +  yTfi(x  -  x)  +  K*  -  x)T D(x  -  x)  . 

a  X 

Since  G(x  -  x)  =  0  , 

cp(x)  -  cp(x)  =  £(x  -  x)T D(x  -  x)  *  0  . 

It  follows  now  that  the  quadratic  form  zTDz  is  convex  on  i  H  N(x,e)  and 
hence  on  i,  its  carrying  plane.  Therefore  cp  is  convex  on  1.  (See 
COTTLE  (1%7).) 

(ii)  Suppose  x  is  a  local  maximum  and  $  /  FP  .  Then  the  Lemma  (2.10) 
implies  that  in  any  sufficiently  small  neighborhood  of  x  there  exists 
a  point  x'  such  that  cp(xx)  >  <p(x).  This  contradicts  the  assumption 

A 

that  x  is  a  local  nuixiinum.  Hence  I  =  FP  and  moreover  c  +  Dx  =  0.  From 
this  we  have 

cp(x)  £  cp(x)  =  cp(x)  +  Vcp(x)(x  -  x) 

for  all  x  in  an  e- neighborhood  of  x,  say  N(x,e).  It  now  follows  that  cp 
is  concave  on  N(x,c)  and  hence  R“  . 

If  cp  8  concave  on  R*  ,  then  of  course,  the  Kuhn- Tucker  conditions 
are  sufficient  to  infer  that  x  is  a  local — indeed  global — maximum. 


-10- 


1 

t 


A 

(iii)  Ii‘  X  /  •'*  ,  and  x  is  a  saddle  point  of  ip  on  X  then  cp  is  not 

A  A 

c ■  i  nvex  on  X  by  (,  i ) .  I1‘  cp  is  not  convex  on  I  then  x  is  neither  a  local 

A 

minimum  by  (i)  nor  a  local  maximum  since  X  f  Ff ,  so  it  must  be  a  saddle 
point  of  cp  on  X.  If  X  =  Rf*  ,  parts  (i)  and  (ii)  leave  only  the  conclusion 
that  x  is  a  saddle  point  if  and  only  if  cp  is  neither  convex  nor  concave 
(i.e.  xtDx  is  an  indefinite  quadratic  form). 

(2.12)  REMARKS.  Simple  examples  show  that  the  exclusion  of  weakly 
binding  constraints  from  the  statement  of  (2.1l)  Is  necessary.  Another 
important  fact  about  this  theorem  is  that  if  (x*,y*)  is  a  Kuhn- Tucker 
point  for  (?.6)  and  the  function  cp  is  convex  on  the  linear  manifold  X, 
then  x*  is  a  local  minimum  cp  on  X  (i.e.,  in  the  problem  (2.6))  and  not 

A  A 

just  in  the  quadratic  program  derived  from  the  lata  c,D,G,h. 

While  'Ihet  rem  (2.1 1)  gives  a  useful  sufficiency  condition  for  a 
local  minimum,  the  goal  4  s  to  determine  a  global  minimum.  With  this 
in  mind,  we  mention  here  un  obvious  but  useful  global  sufficiency  con¬ 
dition  giver,  iy  RITTER  (l''oh).  let  x*  be  a  feasible  vector  for  (2.6) 
such  that  G(x*)  /  0.  Hy  a  suitable  permutation  of  the  constraints, 


G  and  h  can  be  partitioned  as 


respectively,  so  that 


C0x*  -  ho 
G+x*  >  h* 


(.'.!  ')  I'RuI  of]'!'! ’'Ii:  U  x"  is  a  local  minimum  of  (2.6)  and 

min  fxTI>x  :  GqX  0}  £  0  , 
then  x*  Is.  a  gl  i  a!  minimum  of  cp  <  n  X. 


-11- 


Proof.  We  have  the  identity 

<p(x)  =  <p(x*)  +  ?<p(x*)(x  -  x*)  +  £(x  -  x*)tD(x  -  x*). 

Since  x*  is  a  local  minimum,  there  exists  a  vector  y  such  that  (x*,y  ) 

in  conformity  with  the  parti¬ 
tioning  of  G  and  h.  Then 

c  +  Dx*  -  Gjy0  -  Gjy+  =  0 

-ho  +  GqX*  =  0 

-h*  +  G*.x*  >  0 

y0  *  0 

yot-ho  +  G^x*]  =0  (trivially) 

yj[-h*  +  G+x*]  =  0 

The  last  of  these  Kuhn- Tucker  conditions  implies  y+  =  0,  so  ve  arrive 
at  the  observation  that  the  linear  inequality  system 

Colt  =  c  +  Dx  ,  y0  i  0 

has  a  solution.  By  the  alternative  theorem  of  FARKAS  (190?)  we  see  that 

GqX  >  0,  (cT  +  x*TD)x  <  0 
does  not  have  a  solution.  Hence 

(2.1*0  Gq  2  ^  0  implies  (cT  +  x*tD)z  £  0  . 

Suppose  x  €  X.  Then  (^x  ^  ho,  and  it  follows  that  C^(x  -  x*)  s?  0.  With 
z  =  x  -  x*,  (2.1*+)  implies  Vcft,(x*)(x  -  x*)  =  (cT  +  x*tD)(x  -  x*)  :»  0- 


is  a  Kuhn- Tucker  point.  Let  y  = 


■3 
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Moreover, 
for  all  x 


by  the  hypothesis  of  the  Proposition,  ve  have  (x  -  x*T  )D(x  -  x*)  £ 
6  X.  The  result  now  follows  from  the  identity. 


-13- 


3-  CONSTRUCTION  OF  A  CUTTING  PLANE 


The  results  of  the  preceding  section  enable  one  to  distinguish 
between  stationary  points  of  a  quadratic  program.  Once  a  local  minimum 
has  been  reached,  it  is  natural  to  try  to  introduce  a  cutting  plane 
which  will  exclude  the  previously  determined  local  minimum  without 
excluding  the  global  minimum  if  it  has  not  been  located  so  far.  In 
this  section  we  look  at  the  cutting  plane  problem  (Phase  III)  and  post¬ 
pone  until  the  next  section  the  matter  of  finding  a  local  minimum  (Phase  II ). 

Given  a  local  minimum,  it  is  possible  to  determine  a  vertex  of  the 
constraint  set  X  that  lies  in  the  lowest-dimensional  face  of  X  containing 
the  local  minimum.  Then  the  primal  variables  and  their  complementary  dual 
variables  can  be  relabeled  so  that  the  slack  variables  at  that  vertex  are 
denoted  as  v- variables.  After  this  relabeling  process,  a  series  of 
algebraic  manipulations  can  be  carried  out  to  put  the  problem  in  the  form 

(3>l)  minimize  cp(x)  =  crx  +  2XTDx 

subject  to  v  =  -b  +  Ax 


v  5  0,  x  £  0 

with  (x,v,u,y)  being  the  Kuhn-Tucker  point  associated  with  local  minimum 
sc  •  We  shall  assume  that  this  point  is  a  nondegenerate  solution  so  that 

xi 


with  xx  >  0, 


1 


v  >  0,  x  £  0.  Suppose  that  x  can  be  partitioned  as  x  = 
xa  =  0.  The  nondegeneracy  assumption  implies  ux  =  0,  u2  >  0.  The  reader 
should  be  warned  that  here  the  single  subscripts  pertain  to  subvectors 
and  not  necessarily  to  coordinates  of  the  corresponding  vectors.  This 
usage  should  obviate  the  introduction  of  more  elaborate  notation  without 
leading  to  undue  confusion. 
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As  indicated  in  Section  1,  the  purpose  of  a  cutting  plane  is  to 
exclude  the  previously  determined  local ,  but  nonglobal,  minimum  without 
excluding  a  global  raininr’n.  Geometrically  speaking,  the  previously 
determined  local  minimum  and  the  set  of  global  minima  are  to  be  separated 
by  the  cutting  hyperplane.  How  might  one  want  to  proceed  in  constructing 
such  a  hyperplane?  Suppose  for  the  moment  that  the  set 


S  =  fs 


6rDs  <  0,  sa  *  0} 


is  nonempty  and  "known."  Then  for  each  s  6  S  there  exists  a  smallest 
t§  >  0  such  that 

cp(x  +  Ts)  <  cp(x)  for  all  T  >  rg  . 

If  for  all  s  €  S,  the  point  x  +  t^s^X,  then  x  is  a  global  minimum.  On 
the  other  hand,  if  for  come  s  €  S  and  some  t  >  rf  the  point  x  +  ts  €  X, 
then  an  improvement  can  be  made.  We  define 

Y  fx  +  TS  :  s  €  S,  T  >  Ts]  . 


Thus,  we  are  interested  in  a  supporting  hyperplune  to  the  set  Y. 

The  procedure  described  below  is  a  constructive  method  for  choosing 
a  particular  supporting  hyperplune.  Occasionally  it  is  possible  to 
construct  a  parallel  cutting  plane  that  chops  off  more  of  X. 

Let  eTx  5  t  denote  the  constraint  to  be  adjoined.  Ihe  task  is  to 
specify  the  vector  e  and  the  scalar  t.  This  will  be  done  by  considering, 
the  problem  of  finding  the  global  minimum  for  every  value  of  t  of  the 
quadratic  program 
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(3-2) 


minimize  cTx  +  4xTDx 


subject  to 


Xg  2  0 


eTx  s  t 


The  approach  vrill  be  to  specify  the  vector  e  in  a  manner  which  will 
simplify  the  solving  of  (3*2).  The  inequality  constraint  eTx  £  t  will 
be  called  the  "capacity  constraint"  and  e  will  be  chosen  so  that  for 
each  value  of  t  i  0,  a  global  minimum  for  the  corresponding  program 
(3.2)  exists. 


of  x 


We  partition  c,  D,  and  e  to  be  compatible  with  the  partitioning 

fxi\ 


Thus 


Since  (xx,:>)  is  a  local  minimum  for  problem  (3>l)  with  aj  >  it 
follows  that  Dji  is  nonsingular.  The  stationary 

point  at  hand  is  assumed  to  be  a  local  minimum;  thus  we  know  from 
Theorem  (2.1l)  that  is  convex  on  the  subspace  fx  =  [  1  ]  €  if  :  Xq  =  0) 

r*/ 

Hence,  we  are  assured  that  a  global  minimum  for  (3.2)  exists  when 
ex  is  set  equal  to  zero  and  ea  is  chooBen  to  satisfy  e8  >  0. 

A  global  minimum  in  (  i - P )  must  satisfy  the  Kuhn- Tucker  conditions, 
which  con  be  written  ns  follows: 


(3.3a) 

(3.3b) 

(3-jc) 


0  cx  ♦  Dllxl+Dlaxa 

ua  =  c3  ♦  D 1Jxi  ♦  1^3 x8  +  eaC 


(V 


-  e3xa 
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(3-3d) 


£  s  0,  co  >  0,  u2  ^  0,  Xa  ^  0 


( 3*  3e)  C«»  =  °»  Xa^a  =  0 

The  nonsingularity  of  Du  makes  it  possible  to  eliminate  xx  from  (3.2) 
and  its  Kuhn- Tucker  conditions  (  3 •  3)  -  In  particular, 

xi  =  -Eilci  "  ) 

and  after  the  substitution,  (3*2)  becomes 
(3.U)  minimize  cp(x2 )  =  cxs  +  'xgDxg 

sub  ject  to  xa  ^  0 

e2Xa  i  t 


with 

c  =*  ca  -  ci  Du  g 
5  =  ^22  -  D^DliD12 
cp(x)  =  -iclDlJd 


cp(x)  =  cp(x)  +  cp(x2) 

The  point  x2  =  0  is  a  local  minimum  with  9(0)  =  0  for  all  t  £  0.  For 
t  small  enough,  x2  -  0  will  be  the  only  stationary  point  in  the  constraint 
set  of  (3.^)  and  thus  it  is  the  global  minimum.  Consideration  of 
Theorem  (?.ll)  leads  one  to  the  observation  that  at  any  local  minimum  of 
(3-;0»  other  than  the  point  x2  -  0,  the  capacity  constraint  e2x2  £  t  must 
be  binding,  For  this  reason,  only  points  satisfying  the  Kuhn- Tucker 
conditions  with  the  slack  variable  1  f  the  capacity  constraint  at  zero 
value  (i.e.,  10  ■-  0)  will  be  cons i  1. 


-IT- 


The  Kuhn-Tucker  conditions  for  (3*^)  are 


(3.5a) 

Uq  =  c  +  DX8  +  ea£ 

(3.5b) 

U)  =1-63X9 

(3.5c) 

Uj  ^  0,  Xj  i  0,  J  i  0,  1 

(3-5d) 

0 

11 

3 

VJ> 

O 

11 

:? 

1? 

The  problem  of  determining  a  global  minimum  of  (3-*0  can  be  carried  out 
by  finding  a  nonnegative  basic  solution  of  (3-5a)>  (3-5b)  satisfying 
the  complementary  slackness  condition  (3-5d)  and  giving  the  lowest  value 
of  cp.  The  next  section  should  reveal  that  for  a  given  value  of  t,  the 
problem  of  solving  (3*5)  in  order  to  produce  the  smallest  value  of 
cp  is  simpler  than  the  original  problem  only  in  the  sense  that  its  size 
is  smaller.  The  vector  ea  is  to  be  chosen  so  that  having  the  required 
solution  to  (3-5)  for  a  particular  value  of  t  makes  it  easy  to  obtain 
the  global  solution  ''or  (3*4)  for  all  values  of  t  i  0. 

Let  ea  =  c  >  0.  Then  for  any  solution  of  (3*5)  with  oo  =  0,  we 

have 


(3-6) 


XgDXg  =  -(1  +  £)t 


From  this  relationship  and  the  assumption  that  the  capacity  constraint 
is  binding,  it  follows  that  we  are  seeking  a  point  satisfying  (3.5)  that 
minimizes 


(3-7) 


«p(xa  )  =  t  -  £(l  +  £)t 
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Putting  ct  =  1  +  Q,  we  wil1  treat  the  Problem  of  finding  a  solution  to 


(3.8a) 

ua  =  Dxa  +  cct 

(3.8b) 

0)  =  T  -  CXg 

(3.8c) 

u2  ^0,  Xg  SO,  ct  s  0, 

( 3 . 8d ) 

XgUS  =0,  ctu)  =  0 

with  u)  =  0  which  makes  the  value  of  ct  the  largest  for  each  value  of 
t.  If  ct  ^  1,  the  multiplier  associated  with  the  capacity- 
constraint  is  positive,  and  the  corresponding  Xg  is  a  local  minimum. 
Equation  (3-7)  can  be  regarded  as  saying  that  for  CT  ^  2,  the  correspond¬ 
ing  point  Xg  is  a  global  minimum. 

The  point  x2  =  0  is  a  global  minimum  of  (3*^)  when  t  =  0.  Hence  we 
are  only  interested  in  solutions  for  t  >  0.  For  such  T  we  put 

TT  :  =  u2  /t  x  :  =  x2  /t 


u)  :  =  u) 


A 


ct  :=  ctA 


and  our  problem  becomes  that  of  finding  the  solution  of 
(3.9a)  ii  -  Dx  +  ctc 

(3-9b)  u>  =  1  -  cTx 

( 3 •  9c )  uso,  xso,  SiO,  ct^O 

(3-9d)  x^u=0,  ^  =  0 

with  a)  =  0  and  the  largest  value  of  ct.  Let  (ij*,x*),  (0,ct*)  denote  the 
solution  found.  The  solution  of  (3*8)  can  be  interpreted  according  to 
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the  value  of  t.  In  particular: 

(i)  if  a*  <  1/t,  x2  =  0  is  the  global  -uinimum,  and  Xg  =  tx*  is  no 
special  sort  of  point; 

(ii)  if  1/t  £  «r*  <  2/t,  xg  =  0  is  the  global  minimum  and  xa  =  tx* 
is  a  local  minimum; 

(iii)  if  2/t  s  a*  ,  then  Xg  =  tx*  is  the  global  minimum  of  (3*4). 

Note  that  if  a*  £  0,  then  the  point  x  lJ  ,  with  which  we 

started,  is  a  global  minimum  for  the  original  quadratic  program,  for 
we  have  satisfied  the  hypotheses  of  Proposition  (2.13)* 

Hie  method  given  by  RITTER  for  finding  the  required  solution  of 
(3-9)  requires  the  examination  of  all  the  solutions  of  (3-9)  with  uo  =  0. 

To  simplify  the  operation,  he  gives  some  rules  making  it  possible  to 

avoid  explicit  examination  of  every  solution  of  (3*9). (See  RITTER  (1966),  pp.  347.) 

When  D  is  negative  semi-definite  the  problem  is  much  easier  because 
a  solution  to  problem  (3»9)  can  be  found  in  which  jc*  is  an  extreme  point 
of  the  constraint  region  fx  :  x  ^  0,  cT x  £  l] .  Such  cases  correspond  to 
quadratic  programs  with  concave  minimands.  The  task  of  setting  up  problem 
(3.9)  after  finding  a  local  minimum  will  emerge  as  a  by-product  of  Ritter's 


method  for  finding  that  local  minimum. 

T  (°\ 

Hie  cutting  plane  to  be  adjoined  is  e'x  ^  t,  with  e  =  (  I  ,  where 


only  the  value  t  is  yet  to  be  specified.  This  is  done  first  by  computing 
the  largest  number  tx  such  that  cpM^))  =  cp*  where  cp*  is  the  smallest 

value  of  the  objective  function  yet  found  and  x(t)  =[  ^lCl  "  t^li^12x  ]  _ 

\  **  ) 
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Let 


t2  =  sup  {t  :  Ax(t)  ^  b,  x(t)  s  0} 

Thus  Ta  is  the  largest  value  of  t  such  that  x(t)  satisfies  the  con¬ 
straints  ignored  in  problem  (3-2).  If  Ta  =  •,  this  is  another  indi¬ 
cation  that  the  objective  function  cp  is  not  bounded  below  on  the 
constraint  set  X.  Let 

t  =  max  {tj, ,Ta } 

The  cutting  plane  that  is  adjoined  is  eTx  s  t.  If  t  =  tx ,  the  cutting 
plane  is  a  support  to  Y,  hence  it  excludes  no  local  minimum  yielding 
a  lower  value  of  the  objective  function  than  has  yet  been  determined. 
If  t  =  Ta ,  the  new  lowest  value  of  the  objective  function  is  assumed 
at  the  feasible  point  x(t),  and  no  local  minimum  giving  a  lower  value 
for  cp  is  lost.  Now  the  Phase  I  procedure  must  be  reapplied. 
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4  .  RITTER '  S  ALGORITHM  FOR  FINDING  A  LOCAL  MINIMUM 


4.1.  Overview.  This  section  is  devoted  to  the  algorithm 
described  by  RITTER  (1964),  (1966)  for  the  calculation  of  a  local  minimum 
of  a  quadratic  program.  Our  style  of  presentation  differs  sharply 
from  that  used  by  RITTER.  We  regard  Ritter's  algorithm  as  a  type  of 
principal  pivoting  method,  and  our  aim  here  is  to  in' arpret  it  in  this 
context.  Examining  the  algorithm  from  this  point  of  view  simplifies  the 
presentation  and  results  in  some  simplification  in  the  method  itself. 

Principal  pivoting  algorithms  are  associated  with  solving  linear 
complementarity  problems,  that  is,  systems  of  the  form 

(4.1a)  w  -  q  +  Mz 

(4.1b)  w  5  0,  z  >  0 

(4.1c)  zTw  =  0 


where  M  €  Rpxp.  Hy  suitable  identifications,  the  Kuhn-Tucker  conditions 
of  a  quadratic  program  In  the  form  (P.l)  become  a  special  case  of  (4.1). 
Moreover,  a  convex  quadratic  program  and  its  dual  can  be  solved  by  solving 
the  corresponding  linear  complementarity  problem  (4.l).  (Dee  COTTLE  (1964) 
for  survey  references  on  the  solving  of  linear  complementarity  problems 
see  IEMKE  (lV"8),  COTTLE  and  D ANT. ’.Id  (l'KH)  and  COTTLE  (l?o8).) 

The  system  expressed  in  (4. In)  can  be  recorded  in  the  tabular  form 


(^•0) 


1 


w 


A  solution  of  (4.1a)  is  called  nondegenerate  if  at  most  p  of  its  2p 
unknowns  equal  zero  (or,  more  generally,  at  most  p  of  the  2p  unknowns 
equal  their  "current"  lower  bound). 

The  variable  w,  is  said  to  be  the  complement  of  z, .  Initially, 
in  (4.1a)  wt  are  basic,  the  zt  nonbasic .  The  rules  of  a  particular 
algorithm  may  specify  that  a  nonbasic  variable  be  increased,  and  in 
this  role,  it  is  called  the  driving  variable.  If  the  increase  of  the 
driving  variable  causes  a  basic  variable  to  reach  a  specified  value 
(for  example  zero)  then  the  latter  is  called  a  bio jklng  variable .  The 
pair  of  variables  used  in  the  pivot  operation  (basic  exchange)  is 
denoted  by 

< BLOCKING  VARIABLE,  DRIVING  VARIABLE>  . 

The  blocking  variable  specifies  a  row,  and  the  driving  variable  specifies 
a  column.  Thereby  a  pivot  element  (of  the  tableau)  is  singled  out.  The 
pivot  element  Is  the  rate  of  change  of  the  blocking  variable  with  respect 
to  the  driving  variable. 

This  type  of  algorithm  can  terminate  in  two  ways .  The  first  way 
termination  can  occur  is  with  a  solution  to  (4.l).  Having  a  solution 
to  (4.1)  indicates  that  a  (possibly  vacuous)  block  pivot  could  have 
been  performed  about  a  principal  submatrix  to  go  directly  from  (4.1)  to 
a  basic  solution  of  (4.1a)  satisfying  (4.1b)  and  (4.1c).  (See  PARSONS 
^1967)-)  The  second  is  with  an  indication  that  no  blocking  variable 
exists.  This  type  of  termination  must  admit  of  meaningful  interpretation 
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if  the  algorithm  is  to  be  useful.  In  our  case,  the  system  (4.l)  relates 
to  the  Kuhn- Tucker  conditions  of  a  quadratic  program,  and  the  second 
type  of  termination  must  signify  that  the  problem,  either  has  an  empty 
constraint  set  or  the  objective  function  is  unbounded  below  on  the 
constraint  set.  A  further  requirement  of  a  useful  principal  pivoting 
algorithm  is  termination  after  a  finite  number  of  pivot  operations. 
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h.2 .  Ritter's  Algorithm  for  Determination  cf  a  Local  Minimum 

The  task  to  be  accomplished  is  to  find  a  local  minimum  for  the 


problem 

(4.3a) 

minimize  cTx  +  ; 

(4.3b) 

subject  to  Ax  ^  b 

(4.3c) 

x  ^  0 

It  will  be  assumed  that  x  =  0  is  a  feasible  point;  hence  -b  r>  0. 

The  existence  of  a  feasible  point  can  be  checked  using  the  Phase  I 
procedure .  Clearly  a  feasible  quadratic  program  can  be  written  in  the 
form  ( 4 . 3 )  • 

Let  us  assume  that  some  ct  <  0,  for  otherwise  the  point  x  =  0  is 

a  local  minimum.  (The  case  where  c  >  0,  but  some  ct  =  0  requires 
more  careful  attention  and  this  will  be  given  later.)  The  algorithm 
to  be  described  here  works  by 

maintaining  a  solution  to  the  Kuhn-Tucker  conditions  which  yields  a 
local  minimum  for  the  problem  given  by  (4.3)  augmented  with  a  capacity 
constraint . 

(4.4)  eTx  ^  t  where  et  ^  0  and  ej  >  0  if  c,  s  0  . 

The  vector  e  may  be  any  vector  satisfying  these  requirements  though  it 
is  convenient  to  use  et  =  1  for  all  i .  With  the  parameter  t  =  0,  the 
point  x  -  0  is  obviously  a  local  minimum  for  the  augmented  problem  since 
no  other  point  is  feasible.  At  the  point  x  =  0,  the  capacity  constraint 
eTx  s  t  =  0  is  binding  and  has  a  positive  multiplier.  Then  the 

capacity  constraint  is  relaxed  by  an  increase  of  the  parameter  t.  Next 


the  Kuhn-Tucker  conditions  for  (4.3),  (4.4)  are  used  to  compute  a  local 
minimum  x  =  x(t)  for  this  augmented  problem. 

However,  there  are  conditions  under  which  it  is  impossible  to 
increase  t  so  that  x(t)  remains  a  local  minimum  of  the  augmented  problem. 
Depending  on  how  this  situation  arises,  it  will  be  necessary  either  to 
specify  that  certain  nonnegativity  constraints  (xj  i  0)  be  treated  as 
equality  constraints,  (xt  =  0),  or  to  change  the  capacity  constraint. 

Lemma  (2.10)  shows  that  as  t  is  being  increased,  the  objective 
function  is  being  decreased  as  long  as  the  capacity  constraint 
has  t  positive  multiplier.  After  a  finite  number  of  iterations, 
the  algorithm  either  terminates  with  an  indication  that  the  objective 
function  has  no  finite  lower  bound  on  the  feasible  region  or  the 
multiplier  of  the  capacity  constraint  reaches  the  value  zero.  When  this 
occurs,  we  have  a  local  minimum  to  the  problem  without  the  capacity  con¬ 
straint,  but  we  may  still  have  the  imposed  condition  that  some  of  the 
variables  be  held  at  the  value  zero.  If  there  are  no  such  restrictions, 
the  point  at  hand  is  a  local  minimum  to  (4.1)  and  Phase  III  is  to  be 
executed.  However,  if  we  have  a  local  minimum  to  the  problem  with  the 
additional  conditions  that  some  of  the  variables  be  equal  to  zero,  then 
a  new  capacity  constraint  is  to  replace  the  one  Just  dropped,  and  the 
procedure  is  to  be  continued. 

Each  iteration  of  the  algorithm  corresponds  to  a  different  basic 
solution  to  the  Kuhn-Tucker  equations  for  the  augmented  problem.  If 
these  solutions  are  nondegenerate,  a  decrease  in  the  objective  function 
must  occur  at  each  iteration.  Consequently,  no  basic  solution  of  the 
Kuhn-Tucker  equations  can  be  repeated  and  since  there  are  only  a  finite 
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number,  there  can  only  be  a  finite  number  of  iterations. 

Before  stating  the  details  of  Ritter's  algorithm, 

it  is  necessary  to  mention  two  pivot- theoretic  propositions 

needed  to  demonstrate  the  legitimacy  of  the  algorithm.  Hie 

proofs  of  these  propositions  are  straight-forward  applications  of 

techniques  from  numerical  linear  algebra. 

(4.5)  PROPOSITION:  Consider  the  system  of  homogeneous  linear  equations 
expressed  in  tabular  form  as 


Zl 

za 

W1  = 

M 

m 

WS  = 

raT 

where  M  €  R(  p-1)x( p-1) is  symmetric  and  positive  definite,  m  €  Rp_l,  and 
M>  €  R.  After  the  block  pivot  making  zx ,  w3  basic,  the  tableau  is 


is  positive  definite. 

The  other  little  fact  we  will  need  is 
(4.6)  PROPOSITION:  Consider  the  tableau 


Xi  xs  y 
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If  Dja  is  positive  definite,  then  after  the  principal  block  pivot  making 


u  Xa,  v  the  basic  variables,  the  entry  in  the  tableau  found  at  the 
intersection  of  the  rcw  corresponding  to  vt  and  the  column  corresponding 
to  yt  is  nonnegative. 

In  describing  Ritter's  algorithm  for  finding  a  local  minimum,  we 
display  the  Kuhn-Tucker  equations  for  the  quadratic  program  (4.3) 
augmented  with  the  capacity  constraint  (4.4)  in  the  tableau 


1 

T 

X 

y 

c 

u  = 

c 

0 

D 

-at 

e 

V  = 

-b 

0 

A 

0 

0 

111  = 

0 

1 

-eT 

0 

0 

The  variables  Xj  ,  vt ,  u)  are  primal  variables .  The  variables  vt  are 
slack  variables  for  the  inequality  constraints,  so  Ax  -  v  =  b,  and  in  is 
the  slack  variable  for  the  capacity  constraint,  so  eTx  +  is  =  t.  The 
multipliers  are  Uj ,  yt ,  and  Q;  u  is  the  vector  of  multipliers  for  the 
nonnegativity  constraints,  y  is  the  vector  of  multipliers  for  the 
inequality  constraints  Ax  ^  b,  and  £  the  multiplier  for  the  capacity 
constraint. 

For  any  value  of  t,  say  t,  the  corresponding  value  of  the  vector 
in  a  basic  solution  of 

of  basic  variables  the  Kuhn-Tucker  equations  is  found  by  adding  the 
first  column  to  t  times  the  second  column  of  the  tableau. 

Now  for  the  details  of  the  algorithm.  Specific  rules  are  printed 
in  italics.  Comments  and  Justifications  are  included  in  each  step  in 
ordinary  roman  type . 
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>  o};  it  is  assumed  that  x  =  0, 


STEP  1*  l£t  cr/er  =  min  {cj/ej  :  ej 
is  not  a  local  minimum,  aud  c,./er  <  0*  Perform  the  pivots 
<(i),x,.>  to  complete  a  2  X  2  principal  block  pivot. 

The  values  of  the  variables  after  the  pivot  are: 


(4.7)  u,  =  (c,  -  fj-  <0  +  t(|^  -  d,r) 

1  ,  Xj  -  0,  (j^r;  J  -  1,2, .  •  .,n) 

Ur  =  0 

*  ■  t(U 

Vi  =  -bt  - 

yi  =  0  (J.  =  1,2,  . .  -  ,m) 

c  -*-#) 

a)  =0 

Since  -b  £  0,  this  point  satisfies  the  Kuha-Tucker  conditions  when 
t  =  0.  If  the  problem  is  nondegenerate,  then  for  some  >  0,  the  point 
given  by  (4.7)  satisfies  the  Kuhn- Tucker  conditions  in  the  range 
0  £  t  £  tx .  The  specification  of  tx  is  given  in 

STEP  2.  If  the  column  of  t  is  nonnegative,  then  terminate  the  procedure. 
In  such  a  case,  t  as  a  driving  variable  is  not  blocked.  Lemma  (2.10) 
inplies  that  if  t  approaches  infinity,  the  objective  function  is  un¬ 
bounded  below  on  X.  If  the  t  column  contains  at  least  one  negative  entry, 
then  increase  t  until  some  basic  variable  becomes  zero.  Let  be  the 
value  of  t .  The  assumption  of  nondegeneracy  implies  that  this  basic 
variable  is  unique.  The  basic  variable  that  becomes  zero  when  T  =  Tt 
is  the  "candidate”  to  become  the  blocking  variable.  If  the  candidate  to 
become  the  blocking  variable  is  the  multiplier  associated  with  the 
capacity  constraint,  then  go  to  step  6;  otherwise  go  to  the  next  step. 
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STE1  3-  We  want  to  make  a  principal  pivot  so  as  to  bo  able  1  >  i 
t  a  little  bit  more  before  any  other  basic  variable  becomes  ne.oiU  v<  . 
The  desired  pivot  is  on  the  blocking  variable  candidate  and  its  comple 
ment,  and  feasibility  can  be  preserved  only  if  the  pivot  entry  iB 
positive.  This  can  be  seen  by  considering  the  following  tableau  where 
the  blocking  variable  candidate  is  wa 

wi  -* 

w3  - 

wi  ,  zlt  ,  f,  d  €  R1”1  and  wa ,  '/g  ,  ca ,  f a ,  6  are  scalars. 


Fwl-  Tx  a  T  <  Ta  :  -ca/fa  , 

ca  +  Tfa  >  0,  Cj  +  Tfj  >  0 

' !  n  J  I'tlT  1  >  Ty 

ca  +  Tfa  <  0  . 

1  i  ■  -•  0,  tin  n  pcrf>. filing  the  pivot  (v3,za>  results  in  the  tableau 


1 

T 

'/L  v/L! 

1 

,  i’a  d 

1  «•,  -  --  d 

*  r 

D  -  6  'l!lT  6  '! 

-  I'e 

1  .r  1 

L 

*  J  6 

So  for  t  >  Ta , 

--|(ca  +  Tfa)  >  0  ; 

for  some  t3  >  Ta  , 

(cx  +  Tfi )  _'|(c3  +  Tfa )  d  >  0,  if  t3  s  t  <  t,  . 

Hence  t^e  rule  Is:  If  the  desired  pivotal  entry  Is  positive, 

then  the  blocking  variable  candidate  Is  the  blocking  variable  and  Its 

complement  acts  as  a  driving  variable  In  a  pivot  operation.  Upon 

completion  of  this  pivot,  repeat  step  2.  If  the  desired  pivotal  entry  1b 
negative  or  the  blocking  candidate  Is  a  multiplier,  go  to  step  4.  If  the  block 
lng  candidate  Is  a  primal  variable  and  the  pivotal  entry  Is  zero,  go  to  step 

Since  we  only  make  pivots  about  positive  pivotal  entries,  after 
step  1,  the  principal  block  pivot  entry  is  positive  definite.  Repeated 
application  of  Proposition  (4-5)  indicates  that  this  is  so.  Hence  the 
primal  variables  of  the  augmented  problem  that  are  zero  specify  a  face 
of  the  feasible  region  containing  the  current  point  and  restricted  to 
which  the  quadratic  objective  function  is  convex.  The  principal  block 
pivotal  entry  placing  the  point  on  that  face  is  positive  definite.  Hence 
by  Theorem  (2.1l)  the  current  point  is  a  local  minimum  for  the  augmented 
problem. 

If  the  blocking  variable  is  a  multiplier,  performing  the  indicated 
principal  pivot  increases  the  order  of  the  pivotal  block,  and  the 
objective  function  is  to  be  restricted  to  a  higher-dimensional  linear 
manifold,  since  fever  primal  variables  are  at  the  zero  level.  If  the 
blocking  variable  is  a  primal  variable,  then  the  order  of  the  principal 
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pivot  block  is  decreased,  and  the  objective  function  is  to  be  restricted 
to  a  lower-dimensional  linear  manifold.  Thus,  if  it  is  convex  on  the 
higher-dimensional  linear  manifold,  it  must  be  convex  on  the  manifold. 

If  the  blocking  candidate  is  a  primal  variable,  then  the  pivotal 
entry  is  nonnegative.  Proposition  (4.6)  implies  that  if  the  blocking 
candidate  is  a  primal  variable  in  the  role  of  a  slack  variable,  then 
the  pivotal  entry  is  nonnegative.  If  the  blocking  variable  is  a  primal 
variable  not  in  the  role  of  a  primal  s~ack,  then  the  desired  coefficient 
is  on  the  main  diagonal  of  the  current  pivot  matrix.  Since  the  latter 
is  positive  definite,  its  diagonal  elements  are  positive. 

STEP  U.  The  blocking  variable  candidate  is  a  multiplier.  Let  this 
variable  become  negative  and  drop  it  from  consideration  as  a  potential 
blocking  variable  as  long  as  it  remains  negative.  Now  return  to  step  2. 

The  interpretation  is  that  we  now  have  a  local  minimum  for  the  augmented 
problem  with  the  further  restriction  that  the  primal  variables  which  are 
complements  to  the  multipliers  with  negative  values  are  restricted  to 
equal  zero  and  are  not  merely  nonnegative. 

STEP  5*  The  blocking  candidate  is  a  primal  variable,  hence  the  point 
has  moved  to  another  face  of  the  convex  polytope  X.  Let  vr  denote  the 
candidate.  Make  the  pivots  (v, ,uu),  \£,yr )  and  then  drop  the  capacity 
constraint  from  consideration.  All  the  primal  variables  must  be  non¬ 
negative,  and  if  all  the  basic  multipliers  are  positive  the  point  is  a 
local  minimum.  If  some  of  the  multipliers  are  zero  but  none  are  negative, 
it  is  necessary  to  examine  the  principal  submatrix  at  the  intersections  of  the 
rows  of  the  basic  multipliers  at  zero  value  and  their  complements.  If  that  matrix 
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is  positive  semi-definite,  then  the  current  point  is  a  local  minimum. 

If  the  current  point  is  a  local  minimum,  terminate  Phase  II;  otherwise 
go  to  step  7* 

STEP  6.  The  blocking  variable  is  £;  make  the  pivot  (C,u>).  Hie  pivot 
entry  must  be  positive  since  the  coefficient  in  the  desired  position  is 
the  negative  of  the  coefficient  of  t  in  the  blocking  row.  Hius  we  have 
a  local  minimum  without  the  capacity  constraint.  If  all  the  multipliers 
are  positive,  the  point  is  a  local  minimum  to  the  original  problem. 

Terminate  Phase  II.  If  some  of  the  multipliers  are  negative,  then  go 
to  step  J. 

STEP  7-  Let  Ujj.-.jU,  dciote  the  multipliers  having  negative  values. 

Introduce  a  new  capacity  constraint  eTx  =  t  with  et  >  0,  it  is  customary 
to  set  ej  =1,  (j  =  l,...,s),  ej  =  0(j  =  s  +  l,...,n),  where  xj,  (j  =  l,...,s), 
just  denote  the  complements  of  the  basic  multipliers.  With  t  =  0  the 
current  point  is  a  local  minimum  to  the  problem  with  the  new  capacity 
constraint.  Return  to  step  1  and  proceed  as  before. 

This  completes  the  description  of  Ritter's  algorithm  to  determine 
a  local  minimum.  After  finite  number  of  steps,  either  the  objective 
function  is  shown  to  be  unbounded  below  on  the  feasible  region  X  (and  hence 
we  are  finished)  or  we  stop  with  a  local  minimum  and  must  proceed  to 
Phase  III. 

When  describing  his  algorithm,  RITTER  does  not  employ  the  tabular 
form  used  here.  He  maintains  a  distinction  between  the  x- variables  and 
the  v-variables  which  is  not  necessary. 

We  now  return  to  the  task  of  identifying  the  data  for  the  problem 
to  be  solved  in  the  construction  of  a  cutting  plane.  Let  x  be  the  local 
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minimum  just  found.  As  stated  in  Section  3,  one  could,  in  principle, 
determine  a  vertex  of  the  feasible  region  which  lies  in  the  loves  t- 
dimensional  face  of  X  containing  x.  The  primal  variables  and  their 
complements  could  then  be  relabeled  so  that  the  slack  variables  at 
that  vertex  are  the  v- variables.  Two  non-principal  block  pivots  could 
be  made  in  the  original  tableau  to  make  the  v-variables  and  the  u 
variables  basic  in  the  Kuhn-Tucker  equations.  Let  the  following  *abLeau 
represent  that  situation. 


(4.8) 


1 

*1 

Xb 

y 

U1 

Cl 

Dll 

Dja 

-V 

ua  = 

ca 

Dja 

1^3 

-a; 

V  - 

-b 

Ao 

G 

where  the  vector  x  has  been  partitioned  so  that  the  positive  primal 
variables  at  the  local  minimum  are  xl  and  v.  The  vector  c  and  u  and  the 
matrices  D  and  A  are  partitioned  in  a  compatible  fasnion.  The  tableau 
corresponding  to  the  local  ndnlmum  is, 


(4.9) 

1 

“i 

xa 

y 

Xj 

’!)U  cl 

Dfl 

-T\-\  nri 

J  A  \ 

Ua  = 

ca  -  LisDi’iC! 

DiT3Df! 

Haa-D/aDfJ  I\a 

-Aj+Dja  Aj1 

V 

-b  - 

AxDii 

Ax  Dj  i  Ax 

Go  the  problem  to  t>e  solved  in  iliusi  111  is  to  find  a  nonnegative 
complementary  solution  for 


-  <U- 


(*.10) 


1 


x 


a 


aw 

u  = 

0 

Daa-DxaDflDia 

aw 

V  = 

1 

ca  -DjaDfJcj.  0 

that  gives  the  largest  value  for  a • 

Tableau  (4.10)  is  formed  from  data  contained  in  the  rows  associated 
with  the  multipliers  that  are  basic  in  tableau  associated  with  the  local 
minimum.  This  indicates  that  to  set.  up  the  required  Phase  II  problem, 
it  is  only  necessary  to  identify  the  primal  variables  that  are  comple¬ 
mentary  to  the  multiplier's  that  are  bas^**  in  the  final  tableau  of 


Phase  II. 


(Objective  Function) 


r 


cp(x) 


+ 


2 
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We  will  illustrate  the  method  on  the  nonconvex  quadratic  program: 


minimize  cp(x)  r^jXi  -  ^Xg  -  *,xf  +  ^Xq 

2xi  +  Xa  ^  6 

-xi  +  4xa  £  6 

xi  s  0,  Xq  s  0 

Figure  1  depicts  the  set  of  feasible  points  and  some  of  the  isovalue 
contours  of  cp.  4s  indicated  there,  the  problem  has  three  stationary 
points;  two  are  local  minima,  and  one  is  a  saddle  point. 

The  point  x  -  0  is  a  feasible  point,  so  the  method  can  be  started 
in  Phase  II  to  determine  a  local  minimum. 


Phr.6e  II.  Determining  a  local  minimum. 

The  capacity  constraint  is  Xj  ♦  Xa  £  r.  The  first  two  pivot:  re 
for  initialization. 


1/2 

0 

-1/2 

0 

6 

0 

6 

0 

0 

1 

Pivot: 

<ua,C> 


Pivot: 

(aj,Xa> 


For  T=l/r> 

C  is  the 
blocking 
variable . 
Make  the 
pri ncipal 
pivot 

<c.^>  • 


A  Kuhn-Tuoker 
point  and  th< 
point  Xj  o, 
x3  in  a 

local  minimum 
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Phase  III.  Constructing  a  cutting  plane. 

To  place  the  cutting  plane  the  complementary  solution  for 


1 

*1 

a 

II 

%  H 

*3 

0 

-1 

1/2 

U)  = 

l 

-1/2 

0 

with  a)  = 

0  and  the  largest  value  of  a  is  to 

be  found.  Clearly  the  only 

possible 

solution  is  with  <j  and 

*1 

as  the  basic  variables.  So  the 

solution 

tabluau  is 

1 

U) 

/V/ 

0  = 

4 

-4 

2 

II 

2 

-2 

0 

For  the  problem 

minimize  <p(x)  =  gxx  -  gota  -jxf  +  jx§ 

Xj  2  0 

and  0  £  t  £  £  the  point  xj(t)  =  2t,  x^t)  =  ^  is  not  even  a  stationary 
point.  But  for  £  <  t  £  x(t)  is  a  local  minimum  and  x  =  is  the 
global  minimum.  Finally  for  t  s  x(t)  is  the  global  minimum. 

The  final  step  of  constructing  the  cutting  plane  requires  the 
determination  of  tx  and  t2 .  Solving  for  the  largest  t  such  that 
cp(x(x ))  =  cp(x)  gives  tx  =  g^and  solving  for  the  largest  t  such  that 
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x(t)  t  X  gives  t3  =  l/8.  Thus  t  =  ll/8  and  the  cutting  plane  to  be 
adjoined  is  £xx  2  ll/8  (i.e.,  xx  ^  llA)* 


With  the  cutting  plane  adjoined,  the  problem  becomes 
minimize  $(x)  =  |xx  -  |xg  -  £x?  +  ^x§ 
subject  to  2xx  +  xq  £  6 

-  xx  +  kxg  £  6 

xx  *  llA 

xx  25  0,  Xg  ^  0  . 

Notice  that  x  =  0  is  not  a  feasible  point  so  Phase  I  must  be  executed. 
The  result  of  Phase  I  is  a  problem  in  the  form 

minimize  <p(v3,vx)  =  -9Ava  +  ^(v3,vx  )(l  ) 

subject  to  -9v3  -  4vx  +  va  =  2j/k 

2v3  +  vx  +  Xq  =  l/2 

-  v3  +  xx  =  llA 

X  2  0,  V  2:  0  . 
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Phase  II.  Determining  a  second  iocal  minimum. 


Now  the  capacity  constraint  vx  >  v3  £  T  is  introduced.  We  perform 
two  initialization  pivots. 


m 

V3 

vi 

ya 

u2 

Ul 

c 

y3  = 

-9/h  . 

0 

3 

2 

-9 

2 

-1 

1* 

Pivot: 

yi  = 

0 

0 

2 

1 

-4 

1 

0 

1 

<y3,C> 

V2  = 

27/4  • 

0 

9 

4 

0 

0 

0 

0 

xa  = 

1/2  ; 

0 

-2 

-1 

0 

0 

0 

0 

Xl  = 

n/4  . 

0 

1 

0 

0 

0 

0 

0 

ID  = 

0 

1 

-1 

-1 

0 

0 

0 

0- 

l 

T 

V3 

V1 

y2 

ua 

y3 

c  = 

9/4  . 

0 

-3 

-2 

9 

-2 

1 

i 

Pivot : 

yi  = 

9/4  ' 

0 

-l 

-1 

5 

-1 

1 

i 

<tu,v3> 

v2  = 

27/4  . 

0 

9 

4 

0 

0 

0 

0 

X2  = 

1/2  ‘ 

0 

-2 

-l 

0 

0 

0 

0 

Xl  = 

ll/4  . 

0 

1 

0 

0 

0 

0 

0 

(D  = 

0 

1 

-1* 

-1 

0 

0 

0 

0 

In  the 

following  tableau  when 

T  =  1/4, 

x2  is 

the  blocking  candidate. 

A  new  vertex  of  the 

feasible 

region  has  been 

found . 

Make 

the 

multiplier  of  the  capacity  constraint  nonbasic  by  performing  (x2,iu) 
and  <C,u3>. 


1 

T 

UD 

Vl 

ya 

ua 

U1 

y3 

c  = 

9/4  . 

j 

3 

1 

9 

-2 

1 

l 

yi  = 

9/4  * 

-i 

1 

0 

5 

-1 

1 

l 

V2  = 

27/4  *. 

9 

-9 

-5 

0 

0 

0 

0 

X2  = 

1/2  ' 

-2 

2* 

1 

0 

0 

0 

0 

Xl  = 

11/4  . 

1 

-1 

-1 

0 

0 

0 

0 

V3  = 

0 

1 

-1 

-1 

0 

0 

0 

0 

l 

T 

X2 

Vl 

ya 

ua 

y3 

C  =  = 

3/2  ■ 

0 

3/2 

-1/2 

9 

-2* 

1 

i 

yi== 

2 

0 

1/2 

-1/2 

5 

-1 

1 

i 

V2  = 

9 

0 

-9/2 

-1/2 

0 

0 

0 

0 

(U  = 

-=t 

i — 1 

I 

1 

1/2 

1/2 

0 

0 

0 

0 

Xi  = 

0 

-1/2 

-1/2 

0 

0 

0 

0 

V3  = 

1/4  ; 

0 

-1/2 

-1/2 

0 

0 

0 

0 

Pivot: 

(x2,u>> 


Pivot: 

<C>ua> 
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The  resulting  tableau  gives  another  local  minimum. 


1 

T 

*8 

vl 

ya 

C 

ux 

y3 

ua  = 

3/4  . 

0 

3/4 

-1/4 

9/2 

-l/2 

1/2 

1/2 

yi  = 

5/4 

0 

-1/4 

-1/4 

1/2 

1/2 

1/2 

1/2 

va  = 

9 

0 

-9/2 

-1/2 

0 

0 

0 

0 

U)  = 

-i/4  ; 

1 

1/2 

1/2 

0 

0 

0 

0 

*1  = 

3 

0 

-1/2 

-1/2 

0 

0 

0 

0 

V3  * 

i/4  ; 

0 

-1/2 

-1/2 

0 

0 

0 

0 

Placing  the  next  cutting  plane  results  in  an  empty  feasible  region. 


-42- 


4.4  Concluding  Remarks 


In  Phase  II  of  Ritter's  method,  it  is  not  necessary  to  use  the 
algorithm  given  here.  It  can  be  replaced  by  any  quadratic  programming 
algorithm.  Such  algorithms  have  been  given  by  HEALE  (1955)>  (1967)  and 
KELLER  (1969).  The  latter  is  closely  related  to  Ritter's  Phase  II  but 
is  simpler  and  makes  no  use  of  a  capacity  constraint.  A  more  detailed 
analysis  of  this  relationship  will  be  the  subject  of  a  future  report. 

Each  phase  of  Ritter's  method  has  been  shown  to  be  finite  and  in 
his  paper  RITTER  (1966)  has  given  an  argument  proving  that  when  X  is 
bounded  one  will  cycle  through  the  three  phases  only  a  finite  number 
of  times.  It  is  apparent  from  the  description  of  the  method  that  it 
may  require  an  inordinate  computational  effort.  For  concave  problems 
where  there  can  be  a  very  large  number  of  local  minima,  one  could  be 
so  unfortunate  as  to  locate  them  in  order  of  decreasing  value  of  the 
objective  function,  and  thereby  enumerate  them  all.  Although  in  this 
case  the  computational  effort  to  construct  the  cutting  plane  is  small, 
it  may  be  necessary  to  add  a  large  number  of  them.  This  can  lead  to 
much  work  because  the  effort  to  locate  the  local  minima  is  proportional 
to  the  number  of  variables  plus  the  number  of  constraints.  Linear 
programming  can  be  used  to  eliminate  constraints  made  superfluous  by 
the  cutting  plane  but  this  requires  additional  computational  effort. 

(See  RITTER  (1965).) 

The  case  where  D  has  a  number  of  both  positive  and  negative  eigen¬ 
values  can  possibly  cause  this  algorithm  quite  a  lot  of  difficulty.  In 
this  case,  the  finding  of  a  solution  to  the  problem  in  order  to  construct 
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the  cutting  plane  may  require  an  inordinate  amount  of  computational  effort. 


Since  problem  (3*9) 
devise  methods  that 


has  such  simple  structure,  it  may  be  fruitful  to 
exploit  its  special  features. 


-kk- 


REFERENCES 


1.  ABADIE,  J.  (1967),  Nonlinear  Programming,  North-Holland,  Amsterdam. 

2.  BEALE,  E.  M.  L.  (1955),  "On  Minimizing  a  Convex  Function  Subject  tc 
Linear  Inequalities,"  J.  Roy.  Statist.  Soc.  (B)  17 >  173- 184. 

3.  BEALE,  E.  M.  L.  (1967),  "Numerical  Methods,"  in  (J.  Abadie,  ed.) 
Nonlinear  Programming,  North-Holland,  Amsterdam. 

4.  BOOT,  J.  C.  G.  (1964),  Quadratic  Programming,  North-Holland, 

Amsterdam. 

5.  COTTLE,  R.  W.  (1964),  "Note  on  a  Fundamental  Theorem  in  Quadratic 
Programming,"  J.  Soc.  Indust.  Appl.  Math.  12,  663-665. 

6.  COTTLE,  R.  W.  (1967),  "On  the  Convexity  of  Quadratic  Forms  over 
Convex  Sets,"  Operations  Res.  15,  170-172* 

7.  COTTLE,  R.  W.  (1968),  "The  Principal  Pivoting  Method  of  Quadratic 
Programming,"  in  (G.  B.  Dantzig  and  A.  F.  Veinott,  Jr.  eds.)  Mathe¬ 
matics  of  the  Decision  Sciences,  Part  I,  American  Mathematical 
Society,  Providence,  R.  I.,  144-162. 

8.  COTTLE,  R.  V/.  and  G.  B.  Dantzig  (1968),  "Complementary  Pivot 
Theory  of  Mathematical  Programming,"  J.  Linear  Alg.  Appl.  1, 

103-125. 

9.  DANTZIG,  G.  B.  (1963),  Linear  Programming  and  Extensions,  Princeton 
University  Press,  Princeton,  N.  J. 

10.  DANTZIG,  G.  B.  and  A.  F.  Veinott,  Jr.  (1968),  Mathematics  of  the 
Decision  Sciences,  Part  I,  American  Mathematical  Society,  Providence, 

R.  I. 

11.  FARKAS,  J.  (1902),  "Theorie  der  Einfachen  Ungleichungen, "  J,  Heine 
Angew.  Math.  124,  1-27- 

12.  FIACCO,  A.  F.  and  G.  McCORMICK  (1968),  Nonlinear  Programming: 

Sequential  Unconstrained  Minimization  Techniques,  Wiley,  New  York. 

13*  KELLER,  E.  L.  (1969),  Quadratic  Optimization  and  Linear  Complementarity, 
Doctoral  Dissertation,  University  of  Michigan,  Ann  Arbor. 

14.  KUHN,  H.  W.  and  A.  W.  TUCKER  (l95l),  "Nonlinear  Programming, "  in 

J.  Neyman,  ed.)  Second  Berkeley  Symposium  on  Mathematical  Statistics 
and  Probability,  University  of  California,  Berkeley  and  Los  Angeles, 
481-492. 


-4“. 


KUNZI,  I!,  and  W.  KRELLK  ( lXs ) ,  Nichtlineare  Programmierung,  Springer- 
Verlag,  Berlin-Guttingen-Heidelberg. 


1 6.  LEMKE,  C.  E.  (l'X>8),  "On  Complementary  Pivot  Theory,"  in  (G.  B.  Dantzig 
and  A.  F.  Veinott,  Jr.,  eds.)  Mathematics  of  the  Decision  Sciences, 

Part  I,  American  Mathematical  Society,  Providence,  R.  I.,  95-114. 

17.  McCORMICK,  G.  (lXl),  "Second  Order  Conditions  for  Constrained 
Minima,"  SIAM  J.  Appl.  Math.  15,  641-652. 

18.  PARSONS,  T.  D.  (1X7),  "Applications  of  Principal  Pivoting,"  to 
appear  in  (H.  Kuhn,  ed.)  Proceedings  of  the  Sixth  International 
Symposium  on  Mathematical  Programming,  Princeton  University  Press 
Princeton,  N.  J. 

19*  RITTER,  K.  (1964),  Uber  das  Maximum  -  Problem  fur  Nichtkonkave, 
Quadratische  Funktionen,  Doctoral  Dissertation,  Albert- Ludwigs 
University,  Freiburg. 

20.  RITTER,  K.  (1965),  "Stationary  Points  of  Quadratic  Maximum  - 
Problems,"  Z.  Wahrscheinlichkeitstheorie  verw.  Geb.  4,  149-158. 

21.  RITTER,  K.  (lQ06),  "A  Method  for  Solving  Maximum  Problems  with  a 
Nonconcave  Quadratic  Objective  Function,"  Z.  Wahrscheinlich- 
keitntheorie  veiv.  Geb.  4,  ?40-'35l- 


Uric  lass  i  f  i  •■d 


Security  Classification  _ 


DOCUMENT  CONTROL  DATA  -  RAD 

(Jmcurttr  clmmmtHcmtlan  ml  Hilt.  body  W  mbmtrmct  id  Maihi  mumUUmt  mmmd  bm  — — W  ■»—  *»  wH  wgg  <«  «lw«aM) 


V  ORIGINATING  ACTIVITY  (Corpormtm  puthpt)  *».  RCPORT  4ICURITV  CLUIIFIC4TKW 

Department  of  Operations  Research 

Stanford  University  a*,  aaoua  *  ^ 

^Stanford,  Calif.  9**305  _ 


j  report  TiTLe 

RITTER'S  CUTTING  PLANE  METHOD  FOR  N0NC0NVEX  QUADRATIC  PROGRAMMING 


4.  DESCRIPTIVE  MOTES  (Typm  el  import  end  Mctuln  dmlmti 

Technical  Report  _ 


5  AUTHORf-SJ  (Lmet  nmmm.  ttrmt  nmmm,  Inltlmt) 

COTTLE,  R.  W.  and  M/LANDER,  W.  C. 


4  REPO  RT  OATE 

July,  1969 


B  *  CONTRACT  OR  GRANT  NO. 

N00014-67-A-0112-0011 

6  project  no 

NH-047-064 


7m  TOTAL  NO.  OP  RA4II 

1*6 


9  m  ORIOINATOR'S  R  C  PON  T  NUMRERfJJ 

69-11 


t b.  OTHER  REPORT  nc *5)  (Any  other  numbmrm  *1* 
thle  report) 


to  AVAILABILITY/LIMITATION  NOTICES 


This  document  has  been  approved  for  public  release  and  sale;  its  distribution 
Is  unlimited. 


tl.  SUPPLEMENTARY  NOTES 


n  AUSTRACT 


12  SPONSORING  MILITARY  ACTIVITY 

Operations  Research  Program  (Code  1*34) 
Office  of  Naval  Research 
Washington,  D.C. 


The  cutting  plane  method  of  K.  Ritter  for  nonconvex  quadratic 
programming  is  reviewed  and  placed  in  the  context  of  principal 
pivoting  methods.  The  algorithm  is  illustrated  by  an  example. 


u'O  Xl 1473 


.classified _ 

Security  Classification 


.  curitv  Clns:;ific;:tion 


Norioonvex  quadratic  programming 
Principal  pivoting 


Cutting  plane 
Algorithm 


INSTRUCTIONS 


1.  ORIGINATING  ACTIVITY:  Enter  the  name  and  addreaa 
of  the  contractor,  aubcontractor,  grantee.  Department  of  De¬ 
fense  activity  or  other  organization  (corporate  author)  issuing 
the  report. 

2a.  REPORT  SECURITY  CLASSIFICATION:  Enter  the  oven- 
all  security  clonolflcotlon  of  the  report.  Indicate  whether 
“Restricted  Data”  Is  Included.  Marking  la  to  be  in  accord¬ 
ance  with  appropriate  security  regulations. 

26.  GROUP:  Automatic  downgradin';  is  specified  in  DoD  Di- 
(active  S200. 10  and  Armed  Forces  Industrial  Manual.  Enter 
the  group  number.  Also.  when  spplicoble.  show  that  optional 
markings  have  been  U3ed  for  Group  3  and  Group  4  as  author¬ 
ized. 

3.  REPORT  TITLE:  Enter  the  complete  report  title  In  all 
capital  Icttcro.  Titles  in  all  cases  should  bo  unclassified. 

If  a  meaningful  title  cannot  be  selected  without  classifica¬ 
tion,  show  title  classification  In  all  capitals  in  parenthesis 
immediately  following  the  title. 

4.  DESCRIPTIVE  NOTES:  If  appropriate,  enter  the  t  vpe  of 
report,  e.g..  Interim,  progress,  summary,  annual,  or  final. 

Give  the  incluoive  dates  when  a  specific  reporting  period  is 
covered. 

5.  AUTllOR(S):  Enter  tho  nan.e(s)  of  authors)  as  shown  on 
or  in  the  report.  Entet  Inst  name,  first  name,  middle  initial. 

If  military,  uhow  rank  and  brunch  of  service.  The  name  of 
the  principal  author  is  an  absolute  minimum  requirement. 

6.  REPORT  DATE:  Enter  tho  date  of  the  report  as  day, 
month,  year;  or  month,  year.  If  more  thon  one  dote  appears 
on  the  report,  uae  date  of  publication. 

7a.  TOTAL  NUMBER  OF  PAGES:  Tho  total  page  count 
ahould  follow  normal  pagination  procedures,  ie.,  enter  the 
number  of  pages  containing  information 

76.  NUMBER  OF  REFERENCES:  Enter  the  total  number  of 
references  cited  in  the  report. 

8 a.  CONTRACT  OR  GRANT  NUMBER:  If  opproprlote,  enter 
the  applicable  number  of  the  contract  or  grant  under  which 
the  report  was  written. 

86,  8c,  &  Od.  PROJECT  NUMBER:  Enter  the  appropriate 
military  department  identification,  tiuch  as  project  number, 
subproject  number,  aystem  numbers,  task  number,  etc. 

9a.  ORIGINATOR'S  REPORT  NUMQER(S):  Enter  the  offi¬ 
cial  report  number  by  which  the  document  will  be  identified 
and  controlled  by  the  originating  activity.  This  number  must 
be  uniquo  to  this  report. 

96.  OTHER  REPORT  NUMBER(S):  If  the  report  hae  been 
assigned  any  other  report  numbers  (either  by  the  originator 
or  by  the  sponsor),  also  enter  this  number(a). 

10.  AVAILABILIT Y/I. IMITATION  NOTICES:  Enter  any  lim¬ 
itations  on  further  dissemination  of  ths  report,  other  than  those 


Imposed  by  security  classification,  using  standard  statements 
such  as: 

(1)  “Qualified  requesters  may  obtain  copies  of  this 
report  from  DDC.” 

(2)  “Foreign  announcement  and  dissemination  of  this 
report  by  DDC  Is  not  authorized.” 

(3)  "U.  S.  Government  agencies  may  obtain  copies  of 
this  report  directly  from  DDC.  Other  qualified  DDC 
UBers  ahull  request  through 


(4)  “U.  S.  militory  agencies  muy  obtain  copies  of  this 

report  directly  from  DDC  Other  qualified  users 
shall  request  through 


(5)  "All  distribution  of  this  report  ie  controlled.  Qual¬ 
ified  DDC  users  ahull  request  through 


If  the  report  has  been  furnished  to  the  Office  of  Technical 
Services,  Department  of  Commerce,  for  sals  to  the  public,  indl-  I 
cate  this  fact  and  enter  the  price.  If  known. 

1L  SUPPLEMENTARY  NOTES:  Use  for  additional  explana¬ 
tory  notes. 

11  SPONSORING  MILITARY  ACTIVITY:  Enter  the  nome  of 
the  departments!  project  office  or  laboratory  sponsoring  (pay 
Ing  lor)  the  rcscurch  and  development.  Include  addreus. 

13.  ABSTRACT:  Enter  an  obstruct  giving  a  brief  and  factual 
summary  of  the  document  indicative  of  the  report,  even  though 
it  msy  also  appear  elsewhere  In  the  body  of  the  technical  re¬ 
port.  If  additional  space  is  required,  s  continuation  sheet  shall 
be  attached. 

It  Is  highly  desirable  that  the  abstract  of  classified  reports 
be  unclassified.  Each  paragraph  of  the  abstract  shall  end  with 
an  indication  of  the  military  security  classification  of  the  in¬ 
formation  in  the  paragraph,  represented  as  (TS),  (S),  (C),  or  (U) 

There  is  no  limitation  on  the  length  of  the  abstract.  How¬ 
ever,  the  suggested  length  is  from  150  to  225  wonls. 

14.  KEY  WORDS:  Key  words  ore  technically  meaningful  terms 
or  short  phrases  thut  characterize  a  report  and  muy  be  used  as 
index  entries  for  cataloging  the  report.  Key  words  must  be 
•elected  so  that  no  security  classification  is  required.  Identi¬ 
fiers,  such  as  equipment  model  designation,  trade  name,  military 
project  code  name,  geographic  location,  may  be  used  as  key 
words  but  will  be  followed  by  an  Indication  of  technical  con¬ 
text.  The  assignment  of  links,  roles,  and  weights  is  optional. 


nn  F0RM 

U  U  I  JAN  <  4 


1473  (BACK) 


Security  Classification 


